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(57) Abstract: Improved color image display accuracy can be achieved across a computer network by obtaining information char- 
acicri/jng ihc color response of display devices associated with a client residing on the computer network and using the information 
lo m^)di^y color images delivered to the client. The informaton includes a blackpoint estimate for the display devices. The invention, 
in one oniK)dimcnt, makes use of dark elements in the form of non-rectangular shapes such as numerals letters, and the like to aid in 
dctcrminaiion of the blackpoint estimate. In particular, rows or colunms of complex shapes with varying gray values can be displayed 
against a black backgn)und. The use of complex shapes to determine the blackpoint can help resolve minor differences in R, G, and 
B thai can cause poor gray balance. Instead of patches or bars, which may be generally rectangular, more complex shapes can be 
used to aid the human eye in resolving such differences. The information can be obtained, for example, by guiding the client through 
a color profiling process thai profiles the color response of the display device. For example, such guidance may take the form of a 
series of insu-uctional web pages that are delivered to the clienL The web pages can be made interactive to enable collection of color 
characterization data from the client. 
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COLOR IMAGE DISPLAY ACCURACY USING COMPARISON 
OF COMPLEX SHAPES TO REFERENCE BACKGROUND 

TECHNICAL FIELD 

S The invention relates to color imaging and, more particularly, to 

presentation of color images on display devices. 

BACKGROUND 

The growth of the Internet has created sizable opportunities for online 

1 0 retailers^ Most major retailers of consumer products have established commercial 

sites on the World Wide Web, At the same time, the availability of web site 
presence has eliminated many of the marketing barriers previously experienced by 
smaller retailers. Virtually any retailer can now post product information for easy 
access by potential customers, and take orders for its products in an automated 

15 fashion. 

The product information may include a large number of images. The 
images enable web customers situated at client devices to view products before 
submitting an online purchase order. For some items, the user is permitted to 
click on a "thumbnaiP' image to view the item in a higher resolution format. For 

20 many retailers, however, the quality of the images can be a significant concern. 

Color accuracy, in particular, can be very important for retailers of products for 
which color matters. 

In the case of clothing retailers, for example, an image of a sweater should 
match its actual color as closely as possible. Unfortunately, the color output 

25 characteristics of different display devices can differ significantly. A cathode ray 

tube (CRT) or flat panel display, video card, driver software, and operating 
system together determine how RGB pixel values will be rendered and displayed, 
and vary significantly from system to system. 

Consequently, an online customer may order what appears to be a 

30 burgundy sweater but instead receive a bright red sweater. Indeed, color 

inaccuracy has become a significant cause for retum of merchandise purchased by 
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online customers. In some cases, this problem can erase the advantages obtained 
by the retailer's commitment in to online merchandising, and undermine 
continued investment. 

5 SUMMARY 

The invention relates to improvement of color image display accuracy in a 
computer network having display devices with different color output' 
characteristics. The invention, in one embodiment, makes use of gray elements in 
the form of complex, non-rectangular shapes such as numerals, letters, and the 
10 like to aid in a blackpoint estimate for characterization of each display device. 

In particular, rows or columns of non-rectangular shapes with varying 
gray values can be displayed against a black background that serves as a reference 
background. The blackpoint can be estimated by selection of one of the shapes, 
rows, or columns that appears to most closely match the backgroimd. The use of 
15 complex, non-rectangular shapes to determine blackpoint can help resolve minor 

differences in R, G, and B that can cause poor gray balance. 

Instead of patches or bars, which may be generally rectangular, more 
complex shapes can be used to aid the human eye in resolving such differences. 
Numerals, letters, and other complex shapes that are substantially non- 
20 rectangular, for example, engage the pattern recognition capabilities of the human 
eye and can result in heightened sensitivity to gray scale differences. When the 
human eye is called upon to perform pattern recognition, its sensitivity to color 
gradations between a given pattern and a surrounding area increase. The complex 
shape generally presents a longer boundary relative to simple shapes, and 
25 promotes an increased perimeter for contrast. 

In some embodiments, three separate blackpoints can be estimated, one for 
each of the color channels of the display device, e.g., red, green, and blue (R, G, 
and B). Estimation of multiple, channel-specific blackpoints is based on the 
realization that some display devices, such as CRT monitors, exhibit very 
30 different blackpoints for different color channels, and can be difficult to 
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characterize using only a single RGB blackpoint estimate. By estimating the 
biackpoint for each color channel (R, G, 

B) individually, a more accurate characterization of the overall colorimetric 
response of the display device can be obtained* 
5 A more accurate colorimetric characterization, which may result from the 

use of complex shapes in the blackpoint estimate, enables greater accuracy in a 
process for modification of color images that are delivered to and displayed on a 
particular display device. In this manner, the invention can provide improved 
color image display accuracy. This can be achieved, for example, by obtaining 

1 0 the multi-channel blackpoint estimate and other information characterizing the 

color response of a display device associated with a client device residing on a 
computer network. 

The information can be used advantageously to modify color images 
delivered to the client over a computer network such as the World Wide Web. 

1 5 The invention, in various embodiments, may be applied to provide color imagery 

modifications that compensate for the color response of the individual display 
device associated with the client. The display device may take the form of a 
cathode ray tube monitor, flat panel display, or similar color image display 
device. The multi-channel blackpoint estimate and additional information can be 

20 obtained, for example, by guiding the client through a color profiling process that 

profiles the color response of the display device. Guidance may take the form of 
a series of instructional web pages that are delivered to the client. 

The web pages can be made interactive to enable collection of color 
characterization data from the client. The color characterization data can be used 

25 to estimate a variety of information concerning display device characteristics such 

as the multi-channel blackpoint estimate, gamma, gray balance, and the like. 
Once the information has been collected, a color profile can be created for the 
client's display device, and thereafter used for modification of color images 
delivered to the client. The color profile can be incorporated in information that 

30 is transmitted by the client to an image server for modification of color images to 
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be delivered to the client. The information transmitted by the client can be 
embodied in a web cookie or other content container. 

A very accurate value for average gamma of RGB can be determined 
using a series of cascading steps. In some embodiments, for example, a gray 
5 patch selected for the coarse ganuna measurement is used as the central patch for 

a range of gray patches used to measure a more finely tuned gamma. The term 
"gray," as used herein, generally refers to a color formed by combinations of two 
or more color channels of various gray levels, in contrast to colors formed by 
single color channels. The fine ganuna then can be used to form the central gray 

10 patch for gray balance determination. Advantageously, in some embodiments, the 

user can complete the color profiling process in as few as four clicks, while gray 
balance determinations can be completed in a single click. 

A cookie, or alternative container, can provide a persistent representation 
of the color response characteristics of the client's display device. Each time the 

1 5 client accesses a web server and color images are identified in web page content, 

the cookie can be sent to the appropriate image server to improve the accuracy of 
the color image displayed on the client's display device. The cookie may contain 
a computed color profile for a display device or parameters useftil in computing 
such a color profile and thereby rendering color modifications, or "corrections," 

20 to images provided to a client. 

With improved color image accuracy, the images viewed by the client 
appear as intended. The system and method are capable of providing accurate 
characterization of a display device, while affording reliability and ease of use for 
the user. In a retail context, for example, the color of an item of interest more 

25 closely matches the actual color. As a result, items ordered by online customers 

are less likely to be returned based on color mismatch. Online retailers suffer 
from less returns, and online customers can shop with greater confidence that the 
items they order will arrive in the expected color. 

In general, users viewing online images are able to see the colors intended 

30 by the original source without the need for significant adjustments to the display 
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device. Improved color image accuracy can thereby enhance the online 
experience for the client. At the same time, in many embodiments, the user need 
not be burdened with downloadable plug-ins, client side scripts, and the like, 
which can consume time and precious attention span. Instead, in preferred 
5 embodiments, the color profiling process can be carried out by execution of web 

pages. 

In one embodiment, the invention provides a method comprising 
displaying gray elements against a background, wherein each of the gray elements 
has a different gray value and a non-rectangular shape, and estimating a 

1 0 blackpoint for a display device based on one of the gray elements selected by the 

user that appears to most closely match the background. 

In another embodiment, the invention provides a system comprising a web 
server residing on a computer network, the web server transmitting web pages to 
remote clients residing on the computer network, a color image server residing on 

15 the computer network, the color image server transmitting color images 

referenced by the web pages to the clients for display on display devices 
associated with the clients, a color profile server residing on the computer 
network, the color profile server guiding the clients through a color profiling 
process to obtain information characterizing the color responses of the display 

20 devices associated with the clients, wherein the information includes a blackpoint 

estimate for the color channels of the display devices, and the color profiling 
process includes displaying gray elements against a black background, wherein 
each of the gray elements has a different gray value and a non-rectangular shape, 
selecting one of the gray elements that appears to most closely match the black 

25 background, and estimating the blackpoint for a display device based on the 

selected gray element, and one or more color correction modules that modify the 
color images transmitted by the color image server based on the information to 
improve the accuracy of the color images when displayed on the respective 
display device. 
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In an added embodiment, the invention provides a computer readable 
medium containing program code that causes a processor to display gray elements 
against a background, wherein each of the gray elements has a different gray 
value and a non-rectangular shape, and estimate a blackpoint for a display device 
5 based on one of the gray elements selected by the user that appears to most 

closely match the background, 

BRIEF DESCMPTION OF THE DRAWINGS 

FIG. 1 is a block diagram of a system for improving color image display 
1 0 accuracy in a computer network; 

FIG. 2 is a block diagram of a web-based environment incorporating a 
system as shown in FIG, 1 ; 

FIG. 3 is a flow diagram illustrating a method for improving color image 
display accuracy in a computer network; 
1 5 FIG. 4 is a flow diagram illustrating a color profiling process for a display 

device; 

FIG. 5 is a flow diagram illustrating a multi-channel blackpoint 
determination in a color profiling process as shown in FIG. 4; 

FIG. 6 is a diagram of a web page for analog adjustment of a color display 
20 prior to blackpoint determination; 

FIG. 7 is a diagram of a web page for determination of blackpoint for a 
particular color channel; 

FIG. 8 is a flow diagram illustrating gamma and gray balance 
determination in a color profiling process as shown in FIG. 4; 
25 FIG. 9 illustrates a range of gray elements for use in determining a coarse 

gamma in a color profiling process as shown in FIG. 4; 

FIG. 10 illustrates a range of gray elements for use in determining a fine 
gamma in a color profiling process as shown in FIG. 4; 

FIG. 1 1 illustrates a range of gray elements for use in determining gray 
30 balance in a color profiling process as shown in FIG. 4; 
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FIG. 12 illustrates an example of a color image transmitted to a client in a 
system as shown in FIGS. 1 and 2; 

FIG. 13 is block diagram illustrating transmission of color correction 
information in a system as shown in FIGS. 1 and 2; and 
5 FIG. 14 is a block diagram illustrating an alternative architecture for a 

system for improving color image display accuracy in a computer network. 

DETAILED DESCRIPTION 

FIG. 1 is a block diagram of a system 10 for improving color image 
display accuracy across a computer network. The computer network may take the 

1 0 form of a local area network, wide area network, or global computer network such 

as the World Wide Web. In accordance with one embodiment, system 10 can be 
configured to obtain multi-channel blackpoint estimate that characterizes the 
colorimetric response of a display device associated with a client on the network. 
In particular, three separate blackpoints can be estimated, one for each of 

1 5 the color channels of the display device, e.g., red, green, and blue (R, G, and B). 

Estimation of multiple, channel-specific blackpoints is based on the realization 
that some display devices, such as CRT monitors, exhibit very different 
blackpoints for different color channels, and can be difficult to characterize using 
only a single RGB blackpoint estimate. By first estimating the blackpoint for 

20 each color channel (R, G, B) individually, instead of only an overall RGB 

blackpoint, a more accurate characterization of the colorimetric response of the 
display device can be obtained. 

As shown in FIG. 1, system 10 may include a web server 12, a client 14, a 
color image server 16, and a color profile server 18. Web server 12 provides 

25 client 14 with access to web pages incorporating graphic content such as color 

images. Some of the color images can be incorporated in the web pages stored at 
web server 12 while other color images are stored at color image server 16. Web 
server 12 may store lower resolution color images, for example, as well as images 
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that are less color-intensive. Higher resolution color images and more color- 
intensive images can be stored at color image server 16. 

Web server 12, client 14, color image server 16, and color profile server 
1 8 each execute program code that is stored on computer-readable media residing 
locally with the respective device or executed remotely. For client 14, for 
example, the program code may reside in random access memory (RAM) that is 
accessed and executed by the client computer. The program code can be loaded 
into the memory from another memory device, such as a fixed hard drive or 
removable media device associated with client 14. In particular, the program 
code can be initially carried on computer-readable media such as magnetic, 
optical, magneto-optic or other disk or tape media, or electronic media such as 
EEPROM. Alternatively, the program code can be loaded into the medium by 
transmission from a remote data archive, e.g., via a local area network, wide area 
network, or global network such as the Internet. A substantial portion of the code 
may be web page code that is transmitted to the respective device and executed by 
a server or browser application. 

Web page code, e.g., Hypertext Markup Language (HTML), Extensible 
Markup Language (XML), or the like, generated by web server 12 may include 
image tags that point to specific color images stored at color image server 16 or 
elsewhere. When client 14 accesses a particular web page delivered by web 
server 12 and executes the HTML to assemble the page content, color image 
server 16 is accessed to obtain any images tagged within the web page code. 
Thus, the content of a web page assembled for client 14 may include objects 
obtained from different resources within the network occupied by system 10, such 
as web server 12 and color image server 16. In some embodiments, web server 
12 and color image server 16 may be integrated with one another. In the example 
of FIG- 1, however, color image server 16 and web server 12 are separate entities. 
Web server 12 and color image server 16 each may interact with a database server 
and file server to obtain access to selected color images for delivery to client 14. 

Client 14 may take the form of a variety of devices that permit a user to 

8 
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access resources on system 10 and display color images obtained from such 
resources. Examples of client 14 include desktop or portable computers operating 
in a Windows, Macintosh, Unix, or Linux environment, personal digital assistants 
(PDA's), based on the Palm, Windows CE, or similar operating system 
5 environments for small portable devices, Internet-equipped wireless telephones, 

interactive televisions with set-top boxes for Internet access, Internet kiosks 
available to the general public, and future Internet appliances that may emerge. 
Each client 14 preferably executes a graphical viewing application such as a web 
browser to access resources residing on other resources, such as web server 12 

1 0 and color image server 1 6, attached to system 1 0. A web browser application 

permits the user associated with client 14 to readily view web pages generated by 
web server 12, and images served by color image server 16. Other user interface 
applications may be useful in accessing web server 12 provided the information is 
presented in a user-interactive format. 

1 5 In some embodiments, color image server 16 may be configured to deliver 

color corrected video imagery, in addition to static images. Video, such as MPEG 
clips, streaming video, and the like may suffer from similar color accuracy issues 
if they arc not compensated for the effects of the display device associated with an 
individual client 14. Thus, some embodiments of the invention may be 

20 particularly useful for broadcast-like video content. 

In each case, client 14 includes a display device, such as a cathode ray 
tube or flat panel display, for display of color images obtained from web server 12 
and color image server 16. Other types of displays as well as dynamic viewing 
media such as electronic paper are contemplated. Communication between web 

25 server 12, client 14, and color image server 16 may take place using conventional 

network protocols such as TCP/IP. Although some of the client devices described 
above, such as PDA*s and wireless telephones, presently incorporate relatively 
low quality color displays, it is anticipated that such devices will benefit from 
higher quality color displays in the near future. Accordingly, system 10 will be 
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readily applicable in enhancing the quality of color images displayed by PDA's, 
wireless telephones, and similar devices in the future. 

As an illustration, web server 12 may deliver web pages associated with 
an online retailer such as a clothing merchandiser. In this example, the web pages 
5 delivered by web server 12 may contain information concerning an array of items 

offered for sale by the retailer, as well as color images of the items for viewing by 
online customers. Some of the color images may constitute low resolution 
"thumbnail" images placed coincident with hypertext links to higher resolution 
images stored at color image server 16. Client 14 executes the code delivered by 

1 0 web server 1 2 within a browser application to assemble a web page for display on 

a display device associated with the client. 

When a user associated with client 14 clicks on one of the thumbnail 
images vnth a pointing device, such as mouse, trackball, pen, or the like, client 14 
accesses color image server 16 to obtain the higher resolution color image 

1 5 designated by an image tag embedded in the web page code. To permit display of 

the higher resolution color image with greater color accuracy, color image server 
1 6 modifies the color image based on information obtained for client 14. In 
particular, color image server 16 obtains information characterizing the color 
response of a display device associated with client 14. The information can be 

20 uploaded to color image server 16, e.g., in the form of a web cookie or other 

content container. Alternatively, the information can be transmitted, i.e., 
broadcasted, to a number of subscriber color image servers in system 10, which 
are recognized by color profile server 18. The information can be generated by 
guiding a user associated with client 14 through a color profiling process that 

25 profiles the color response of the display device. 

When client 14 accesses a color image fi^om color image server 16, the 
user may be given a choice between viewing a version of the image with default 
color settings, or initiating the color profiling process to produce custom color 
settings for the user's display device and thereby improve the quality of the color 

30 image. In particular, the color image delivered by color image server 16 may be 
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embedded in a web page with one or more hypertext links for initiation of the 
color profiling process through interaction with color profile server 1 8. When the 
user clicks on the hypertext link, client 14 accesses color profile server 1 8 for 
delivery of a series of instructional web pages to the user. 

5 The instructional web pages provided by color profile server 1 8 guide the 

user through a number of steps designed to estimate the color response 
characteristics of the particular display device associated with client i4. When 
the process is complete, color profile server 1 8 delivers a web page with content 
that, when executed, generates a cookie containing the color profile information, 

1 0 The cookie then can be uploaded to color image server 1 6 for use in modifying 

the color image, and subsequently accessed color images, to produce higher 
quality color output on the display device associated with client 14. Exemplary 
color profiling processes will be described in greater detail later in this detailed 
description, 

1 5 Other techniques for obtaining the color profiling information may not 

require direct interaction by the user with a color image server 16a-16n. Instead, 
the user may voluntarily visit a web site to perform color profiling. The web site 
may be provided by color profile server 18 or be within the same domain as the 
color profile server. Alternatively, users may profile the display devices 

20 associated with their individual clients 14a-14n by executing software 

downloaded or physically delivered to them. Moreover, display devices could be 
configured to produce a color profile when put in use, and transmit the color 
profile to subscriber color image servers, e.g., in a cookie. In each case, color 
profile server 1 8 receives essentially the same information for transfer to a 

25 number of individual color image servers for delivery of color corrected images to 

client 14. 

FIG. 2 is a block diagram of a web-based environment 20 incorporating a 
system as shown in FIG. 1. Web-based environment 20 includes a number of 
subscribers 22a, 22b, and 22c-22n, each of which may represent a commercial 
30 retailer with an online merchandising web site. Of course, subscribers 22a-22n 
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may include non-conunercial entities as well, such as art museums and the like. 
For each subscriber 22a, 22b, and 22c-,22n, a subscriber web server, or 
"subscriber server" (SSi-SSn) 12a, 12b, and 12c-12n, delivers web pages with 
content describing the subscriber's merchandise, and a color image server (CIS|- 
5 CISn) 16a, 16b, and 16c-16n delivers high quality color images that may be 

modified based on color profiles generated for individual clients 14a, 14b, and 
14c-14n. Thus, each of subscribers 22a-22n posts its high quality color images to 
a respective color image server 16a-16n, and maintains web pages that invoke the 
high quality images at a respective subscriber server 12a-12n. Note that there 

10 may be many more clients 14a-14n than subscribers 22a-22n. 

One of the subscriber servers 1 2a-l 2n and one of the color image servers 
1 6a- 1 6n preferably are under the control of the respective subscriber. In other 
words, subscriber 22a may be responsible for maintenance, administration, and 
content of subscriber server 12a and color image server 16a, while subscriber 22b 

1 5 is responsible for subscriber server 1 2b and color image server 16b, In this 

manner, subscribers 22a-22n can readily update the contents of subscriber servers 
12a-12n and color image servers 16a-16n themselves. Consequently, subscribers 
22a-22n do not need to relinquish control of their image content to some third 
party in order to take advantage of the color image quality improvements 

20 contemplated in accordance with this embodiment of the invention. Instead, 

subscribers 22a-22n make use of their own color image servers 16a- 16b and 
interaction with a color profile server 18 that guides the color profiling process for 
clients 14a-14n, Nevertheless, in some embodiments, use of a central image 
server for all subscribers may be desirable. The commercial entities associated 

25 with subscriber servers 1 2a- 1 2b and color image servers 1 6a-l 6n are 

"subscribers" in the sense that they all make use of color profiles generated by 
interaction with one or more common color profile servers 1 8. Thus, a subscriber 
may be a retailer or collection of retailers with a web site that employs color 
correction as described herein, and makes use of color profile server 18. 

30 Subscriber server 12a-12n may be the subscriber's main web server. Color image 
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server 16a-16n can be a server that is co-located with or remotely located from a 
corresponding subscriber server 12a-12n and contains the subscriber's high 
resolution or color-intensive color images and a color correction module for 
modifying the images and serving corrected images to clients 14a-14n. Each 

5 color image server 16a-16n may be within the domain of the respective subscriber 

server 12a-12n, but this is not a requirement. Thus, in the environment of FIG. 2, 
clients 14a-14n are potential customers of subscribers 22a-22n who view the 
subscriber's web pages with their own browsers. 

Clients 1 4a- 1 4n access subscriber servers 1 2a- 1 2n, color image servers 

10 16a-16n, and color profile server 18 via World Wide Web 24. Although the 

number of clients 14a-14n and subscribers 22a-22n shown in FIG. 1 is limited for 
ease of illustration, the actual number can be virtually unlimited subject to the 
bandwidth limitations of subscriber servers 12a-12n, color image servers 16a-16n, 
color profile servers 18 and web 24. With a large number of clients 14a-14n 

1 5 accessing subscribers 22a-22n, the color responses of individual display devices 

can be quite varied. The color profiling process and color image modifications 
administered by color profile server 1 8 and color image servers 1 6a-l 6n, 
however, compensate for diflferences between the various client display devices 
and thereby increase the consistency of color output viewed by users situated 

20 across web 24. If subscribers 22a-22n are clothing retailers, for example, the 

color images viewed by clients 14a-14n on disparate display devices can be made 
to more closely match the color of actual clothing items. 

FIG. 3 is a flow diagram illustrating a method for improving color image 
display accuracy in a computer network as shown in FIGS. 1 and 2. When a 

25 client 14 seeks to download a web page from a subscriber server 12, the client 

receives HTML code (or some other form of web page code) with embedded 
image tags identifying the locations of color images to be incorporated in the web 
page when it is presented on a display device, as indicated by reference numeral 
40. For lower resolution images, such as so-called "thumbnails," the image tags 

30 may point to locations resident at subscriber server 1 2. When a user clicks on a 
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thumbnail to access a higher resolution image, or when a higher resolution is 
embedded in the web page in the first instance, client 14 executes the web page 
code to access and download color images from a designated color image server 
16, as indicated by reference numeral 42 in FIG. 3. 
5 In the example of FIG. 3, the web page code executed by client 14 for 

access to color image server 16 queries whether a color profile cookie visible to 
the color image server has been generated for the particular client, as indicated by 
reference numeral 44. A cookie is visible, for example, if it corresponds to the 
domain of the color image server. Management of cookies will be described later 

1 0 in this description. The color profile cookie contains information characterizing 

the color response of the display device associated with client 14, and resides 
locally with the client. If a color profile cookie has been generated, client 14 
uploads the cookie to color image server 16, as indicated by reference numeral 46. 
Color image server 48 retrieves the image requested by client 14 and modifies the 

1 5 image based on the contents of the cookie by applying a color correction, as 

indicated by reference numeral 48. The color correction modifies the image to 
compensate for variations in the color response characteristics of the display 
device associated with client 14. Color image server 16 then downloads the color 
corrected image to client 14, as indicated by reference numeral 50, and the 

20 process ends, as indicated by reference numeral 52. In the above manner, client 

14 receives a color corrected image that is customized for the client's display 
device to provide more accurate color output. 

If a color profile cookie has not been generated previously, client 1 4 
downloads a default color image fi"om color image server 16, as indicated by 

25 reference numeral 54, for presentation on the display device associated with the 

client. The image is a "default" image in the sense that it has not been color 
corrected or otherwise customized for the individual display devices associated 
with client 14. As a result, when displayed by client 14, the default image may 
exhibit significant color inaccuracy relative to the original color image. With the 

30 default image, however, client 14 may present a color profiling option, as 
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indicated by reference numeral 56. In particular, client 14 may download with the 
image an indication of whether color profiling and correction has been applied to 
the image. With the image, client 14 may display that indication along with a 
hypertext icon that may invite the user to carry out color profiling. The user may 

5 click on the profiling icon with a pointing device to access the color profiling 

process. In some embodiments, the profiling icon may indicate that profiling has 
already been performed and that the image has been color corrected, e.g., by 
displaying the icon in color. If profiling has not been performed previously, the 
icon may be displayed in black-and-white or some other indication can be 

10 provided. By clicking on the icon, the user can commence profiling, either in the 

first instance or as a profiling update. 

If the option is not selected, as determined at reference numeral 58, the 
user simply views the default image and the process ends, as indicated by 
reference numeral 52. If the option is selected, however, client 14 executes code 

1 5 that directs it to access color profile server 1 8, e.g., via the hypertext link 

associated with the icon. Color profile server 1 8 guides the user associated with 
client 14 through a color profiling process, as indicated by reference numeral 60. 
The color profiling process produces information characterizing the color 
response exhibited by the display device associated with the particular client 14. 

20 Following completion of the color profiling process, client 1 4 generates a color 

profile cookie, as indicated by reference numeral 62. The color profile cookie 
contains the color characterization information. Client 14 then uploads the color 
profile cookie to color image server, as indicated by reference numeral 46, to 
obtain a color corrected image for improved color image accuracy. As will be 

25 explained, the cookie may need to be rewritten for the domain of the color image 

server 16. 

Notably, as will be described, the color profiling process optionally 
requires no plug-ins, Java scripts, or other significant client-side processes. 
Instead, interaction between subscriber server 12, client 14, color image server 16, 
30 and color profile server 1 8 is driven by execution of the web page code delivered 
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to client 14. This approach yields significant convenience for the end user 
associated with client 14. At the same time, subscribers 22a-22n are not required 
to retain color information for individual users. Rather, the information can be 
uploaded to color image server 16, e.g., in the form of a cookie, whenever color 
5 images are requested by a client 14. Moreover, subscribers 22a-22n can maintain 

their own color images at color image servers 16a-16n, and provide color 
correction by incorporating a color correction module capable of hanciling the 
color profile cookies uploaded by individual clients 14a-14n. Accordingly, there 
is no need for subscribers 22a-22n to post their web pages or images to a central 

10 web repository. 

To carry out a color profiling process as described with reference to FIG. 
3, client 14 interacts with color profile server 1 8. Color profile server 18 delivers 
a series of web pages to client 14. Each of the web pages is designed to guide the 
user through a given step in the color profiling process. One web page, for 

1 5 example, may include instructions and image content designed to extract from the 

user an estimate of the blackpoint of the display device. In one embodiment, the 
blackpoint estimate may be an estimate of multiple, channel-specific blackpoints. 
Other web pages may include instructions and content designed to extract coarse 
gamma, fine gamma, and gray balance information. In particular, each web page 

20 may include interactive media such as hypertext icons and the like that can be 

clicked upon by the user to transfer information from client 14 to color profile 
server 18. 

Upon collecting the necessary information, color profile server 18 creates 
the cookie and delivers it to client 14 for local storage and fixture use. In some 

25 embodiments, two cookies can be provided to client 14. A first cookie may 

correspond to a domain name associated with color profile server 18, and be used 
for fiiture interactive between the particular client 14a-14n and the color profile 
server. The first cookie can be referred to as the "profiler cookie." A second 
cookie may correspond to a domain name associated with the particular color 

30 image server 16a-16n (corresponding to a particular subscriber such as a retailer) 
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from which the color image is to be downloaded. In other words, the second 
cookie may correspond to the color image server 168a- 1 68n at which the color 
profiling process was initiated. In this manner, future images delivered by that 
color image server 16a-16n will be modified based on the contents of the cookie 
5 associated with the pertinent domain. The second cookie can be referred to as the 

"subscriber cookie." 

The profiler cookie can be used to produce additional subscriber cookies 
for use with color image servers 16a-16n associated with other domains. 
Specifically, when a user situated at a client 14a-I4n accesses a color image 

1 0 server 1 6a- 1 6n from which the user has not previously downloaded color 

corrected images, the user can click on the color profiling option and be directed 
to color profile server 18. Upon interaction with color profile server 18, client 14 
simply uploads the profiler cookie instead of repeating the color profiling process. 
Information concerning the domain associated with the new color image server 

15 1 6a- 1 6n can be incorporated in the profiler cookie. 

In response to receipt of the profiler cookie, color profile server 1 8 
delivers a web page advising the user associated with client 14a*14n of the intent 
to send the cookie contents to the domain indicated in the cookie, and may request 
user approval for, among other reasons, privacy concerns. Upon sqjproval by the 

20 users, color profile server 1 8 transmits the cookie contents to the color image 

server 16a-16n designated by the domain in the profiler cookie. In response, the 
color image server 16a-16n creates a subscriber cookie for its own domain, and 
writes the cookie to client 14a-14n for future use. Thereafter, client 14 uploads 
the appropriate subscriber cookie to the pertinent color image server 16a-16n 

25 when requesting color corrected images for the pertinent subscriber 22a-22n, and 

can bypass interaction with color profile server 18. 

The reliance on first and second cookies, one for color profile server 1 8 
and the other for a particular subscriber server 12a-12n or color image server 16a- 
1 6n, is driven in part by existing web design considerations. In particular, cookies 

30 stored on a client's browser typically are marked by the domain of the server that 
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generates them, and are not generally visible to other domains. Thus, cookies 
created by color profile server 18 are not generally visible to color image servers 
16a-16n, and vice versa. Further, cookie visibility can be fiirther restricted by 
marking the cookie with a path within a server's domain. This sort of cookie will 
5 then not be visible on requests to pages outside the path, even if to the same 

domain. Further, a browser routinely sends all visible cookies on each request to 
a server. This includes not only the initial request for an HTML page, but also the 
requests for images to be embedded in the page. Because an image can come 
from a different server than the HTML page, however, the cookies sent for the 

1 0 HTML page can differ from those sent for the image. 

In light of the above considerations, color profile server 18 acts as an 
intermediary not only for administration of the color profiling process, but for 
generation of subscriber cookies. This intermediary function enables color 
correction of all subscriber images to be performed at color image servers 16a- 

15 1 6n rather than at a centralized site. Also, with this intermediary fiinction, once a 

client has gone through the color profiling process, he generally will not have to 
repeat it to obtain color correction of images for additional subscribers. As an 
exception, the user may voluntarily repeat the color profiling process when local 
driver software or hardware such as the display device or video card associated 

20 with a client 14a-14n has changed. Indeed, to encourage updates from time to 

time in order to accommodate hardware changes, expiration dates can be applied 
to the profiler cookie and subscriber cookies. 

It is apparent that the three different servers, i.e., subscriber server 12a- 
12n, color image server 16a-16n, and color profile server 18, divide the labor 

25 involved in color correction transactions. In particular, assuming the existence of 

a profiler cookie and a subscriber cookie, a subscriber server 12a-12n serves the 
HTML for the subscriber's own web pages and handles most other requests for 
those pages, including serving of images that are not subject to color correction. 
Color image server 16a-16n serves the images that are subject to color correction. 
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If color image server 1 6a- 1 6n receives the appropriate subscriber cookie, 
it performs color correction based on the cookie contents and serves the color 
corrected image to the appropriate client device 14a- 14n. Color image server 
16a-16n also may serve an icon near the correctable color images that indicates 
5 whether the color images have indeed been corrected. If color image server 16a- 

16n finds no subscriber cookie, for example, it displays an icon suggesting that 
the user click the icon to initiate the color profiling process. Otherwise, the icon 
merely indicates that color correction is turned "on," i.e., that color correction has 
been applied to the image. 

1 0 Color profile server ! 8, as mentioned above, serves the pages for the color 

profiling process. If the color profiling process is invoked by clicking the icon 
displayed with a color image delivered by color image server 16a-16n, the 
respective client I4a-14n probably does not have a subscriber cookie for the 
pertinent subscriber 22a-22n. In some cases, however, client I4a-14n may be 

1 5 voluntarily repeating the color correction process to update the profile for new 

hardware or software. If a profiler cookie exists, then the process can be 
abbreviated by simply shipping the contents of the cookie to the appropriate 
subscriber domain for creation of the subscriber cookie. 

If the profiler cookie does not exist, then the full color profiling process is 

20 served by color profile server 1 8. Upon completion of the color profiling 

process, color profile server 18 generates the profiler cookie for client 14a-14n, 
and passes the contents of the profiler cookie to the pertinent color image server 
16a-16n. Color image server 16a-16n then generates the subscriber cookie based 
on the profiler cookie contents and invokes the original subscriber URL from 

25 which the color profiling process was invoked. 

the mechanisms for exchanging color correction information between the 
profiler cookie generated by color profile server 18 and the subscription cookie 
generated by color image server 16a-16n may vary. In particular, rather than 
delivering cookies to clients 14a-14n, color profile server 18 may be arranged to 

30 transmit the color correction information to all of the color image servers 1 6a- 1 6n 
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associated with a recognized group of subscribers 22a-22n. In this manner, the 
color profile information obtained by color profile server 1 8 as a result of the 
color profiling process can be "broadcasted" for storage by subscribers 22a-22n. 
The advantage of this approach is that information transfer is seamless. There is 
5 no need for the user associated with a client 1 4a- 1 4n to interact with color profile 

server 18 following the initial color profiling process, other than to update the 
color profile. Rather, each subscriber 22a-22n stores the color correction 
information associated with the individual client 14a-14n, e.g., with a client ID 
code. 

1 0 When the client 1 4a- 1 4n accesses one of the color image servers 1 6a- 1 6n, 

the client ID code is used to retrieve the appropriate color correction information 
and thereby serve a color corrected image. The downside is that each subscriber 
22a-22n needs to maintain a database of color correction information for clients 
1 4a- 1 4n requesting color corrected images from the participating subscribers, 

1 5 including clients who may never access a respective subscriber server 1 2a-l 2n. 

Thus, an approach that makes use of cookies for transfer of color correction 
information may be more desirable for some subscribers 22a-22n. Nevertheless, 
broadcasting of color correction information remains a viable option that may be 
acceptable to some subscribers 22a-22n, and highly convenient for end users. 

20 The following is a description of some of the details that may be 

associated with passing information between subscriber servers 12a-l2n, clients 
1 4a-l 4n, color image servers 16a-16n, and color profile server 1 8 according to an 
indirect cookie transfer approach. This approach is indirect in the sense that the 
user intervenes and enters approval before the profiler cookie contents are 

25 transferred from color profile server 1 8 to a respective color image server 16a- 

1 6n. In delivering web pages to clients 14a-14n, subscriber servers 12a-12n pass 
the URL's for correctable images stored on associated color image servers 16a- 
16n. In addition, subscriber servers 12a-12n preferably incorporate color 
profiling icons near the images. The URL*s for the color profiling icons point to 
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the pertinent color image server 16a- 16n, while the hypertext link associated with 
the icon points to color profilie server 18. 

To accomplish passing of color correction information back to color image 
server 16a-16n, the URL of the page viewed by the user is passed to color profile 
5 server 1 8 when the hypertext link associated with the icon is followed by a client 

14a-14n. This step of passing the URL can be accomplished either by including 
the URL as a parameter on the target URL, or by POSTing the information from a 
form that wraps the icon, i.e., with the URL stored in a hidden entry field. In the 
latter case, the icon serves as a button, which may require some minimal client- 

1 0 side scripting. In addition, as will be described, the name of the subscriber 22a- 

22n and the URL of a completion page to be served by the color image server 
16a-16n after the color profiling process is complete may be included in the 
request to color profile server 1 8. Subscribers 22a-22n can be provided with a 
server-side scripting fiinction that inserts the icon code with the appropriate 

15 URLs. 

For the color profiling process, color profile server 18 serves a number of 
web pages that can be invoked by execution of a web page provided by subscriber 
server 12a-12n. In this case, the "return URL" is passed forward to each page in 
the sequence. The return URL can be passed as a parameter in the target URL, or 

20 by using hidden fields in forms. In some cases, the return URL can be stored as a 

server variable. As mentioned above, color profile server 18 handles two 
scenarios: (1) fiill color profiling when no profiler cookie exists, and (2) creation 
of a subscriber cookie when a profiler cookie already exists. In both scenarios, 
color profile server 18 transfers the contents of the existing or newly created 

25 profiling cookie to the pertinent subscriber 22a-22n. In particular, color profile 

server 18 may present a button that requests permission of the user associated 
with client 1 4a- 1 4n to transfer the information. 

The URL for the button points to a page served by color image server 16a- 
16n. The request sent to color image server 16a-16n includes both the return 

JO URL and the color Information written in the profiler cookie. The request 
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preferably is a POST request from a form, rather than a GET request with all the 
information set forth in the URL due to length considerations. Color profile 
server 1 8 determines the URL of the destination page at subscriber 22a-22n by 
reference to the return URL, Prior to transfer of the cookie contents, the user will 
5 want to know the destination. Accordingly, color profile server 1 8 displays the 

name of the particular subscriber 22a-22n along with the button. If the name of 
the subscriber is not easy to determine from the URL, it can be generated by 
cross-referencing the URL to a name in a database accessible by color profile 
server 18, or by passing the name vsdth the return URL in the original request from 

1 0 the page generated by subscriber server 1 2a- 1 2n. 

Upon receipt of the information from color profile server 18, the pertinent 
color image server 16a-16n serves a page indicating that the color profiling 
process is complete. The page may be invoked by the POST request containing 
the color correction information and the URL of the "return" page, as received 

1 5 from color profile server 1 8. Color image server 1 6a-l 6n writes the color 

correction information to the pertinent client 14a-14n as a client cookie. From 
that point forward, the subscriber cookie is stored by the respective client 14a- 
14n, and is sent to the color image server 16a-16n associated with the pertinent 
subscriber 22a-22n with any request for a color correctable image. In response, 

20 color image server 1 6a-16n extracts the contents of the subscriber cookie, applies 

a color correction to the requested image based on the contents, and delivers the 
color-corrected image to the client 14a-14n. 

As an alternative approach, color correction can be passed from color 
profile server 18 to the color image server 16a-16n associated with the respective 

25 subscriber 22a-22n via a direct request, rather than being embedded in a request 

generated when client 14a-14n clicks on a button, anchor, or other input medium. 
This approach is direct in the sense that the user need not intervene by submitting 
approval for the transfer to color profile server 18. Instead, the transfer of the 
content of the profile cookie to the appropriate color image server 16a-16n can be 

30 made seamless. Indeed, in preferred embodiments, the user associated with client 
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14a-l4n does not even view pages sent by color profile server 18 for transfer of 
information following the initial profiling. In this manner, the transfer of color 
correction information from color profile server 18 to a color image server 16a- 
16n happens automatically, without requiring the user associated with a client 
5 14a-14n to click on a link to effect the transfer. This approach makes the transfer 

appear more seamless to the user. The end result is the same, i.e., the transfer of 
color correction information contained in a profiler cookie to create a subscriber 
cookie without the need for reexecution of the color profiling process by the user. 
To facilitate transfer by direct request, the client 14a-14n is assigned a 
10 client ID. Ordinarily, the client ID can be stored in and received from a 

subscriber cookie on the browser associated with a client 14a-14n. A client 14a- 
14n that is new to the particular subscriber 22a-22n, i.e., a client that does not 
send a subscriber cookie to the particular color image server 16a-16n. will be 
assigned a new client ID, which is sent as a cookie with the HTML in the 
1 5 response from the color image server. All URLs pointing to color profile server 

1 8 then bear both the client ID and a subscriber ID as parameters, so that the color 
profile server can correlate requests for color correction information for the 
respective client 14a-14n. The URL for the color profiling icon points to color 
profile server 18 if there is no subscriber cookie. For this approach, it is preferred 
20 that the respective subscriber server 12a-l 2n and corresponding color image 

server 16a-16n occupy the same domain so that they can view the same cookies. 

As in the indirect approach, a color profiling icon, which appears adjacent 
a color correctable image, may be served from either color image server 16a-16n 
or color profile server 1 8 in the direct transfer approach, depending on whether 
25 the color image server receives a subscriber cookie. If a subscriber cookie is 

present, the profiling icon is served by color image server 16a-16n, and is 
formulated in appearance to indicate that color correction is active, e.g., with a 
text message to that effect. This will be the case for most images served by color 
image server 16a-16n because only new clients 14a-14n will not have the 
30 subscriber cookie. 
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If the subscriber cookie is not presented, the icon is served by color profile 
server 1 8. In other words, the web page served by color image server 1 6a-l 6n has 
embedded in it an icon served by color profile server 18. If a profiler cookie is 
present, color profile server 18 serves an icon that indicates the client 14a-14n has 
5 already been through the color profiling process. If not, the icon indicates that the 

color profiling process has not previously been completed by the respective client 
14a-14n. This may be represented by a colored icon to indicate that color 
profiling has been completed, and a black-and-white icon to indicate that it has 
not. 

1 0 In some embodiments, the icon may indicate that the client 14a-14n has 

been through the color profiling process, but that the color correction information 
has not yet been forwarded to the particular subscriber 22a-22n, and that the 
image has not been color corrected. In either case, color profile server 18 also 
receives the ID for the client 14a-14n and the subscriber 22a-22rt, which are 

1 5 included in the URL forwarded to color profile server 1 8. If the profiler cookie is 

present, color profile server 18 immediately forwards the client ID and the 
contents of the profiler cookie to the pertinent color image server 16a-16n in a 
special-purpose request. 

If the subscriber cookie is present, color image server 16a-16n performs 

20 the color correction based on the information contained in the cookie. If the 

subscriber cookie is not present, color image server 16a-16n waits a short time to 
receive color information for this client from color profile server 1 8. If the 
information is forthcoming, color image server 16a-16n applies the color 
correction and writes a subscriber cookie to the browser associated with the client 

25 1 4a- 1 4n. Otherwise, color image server 1 6a-l 6n serves an uncorrected image. 

With this direct approach, it may be necessary for color image server 16a- 
1 6n to keep track of color correction information forwarded by the color profile 
server 18 because such information may not be received synchronously with 
image requests from clients 14a-14n. Accordingly, it may be necessary to 

30 incorporate a database application that can be shared by color image server 16a- 
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16n for temporary tracking of color correction information associated with 
individual clients 14a-14n, and subscriber server 12a-12n for tracking and 
generation of client ID information. Once the information has been written to a 
subscriber cookie, the ID and color correction information for the respective client 

5 1 4a- 1 4n can be purged from the database. 

Management of ID*s according to the direct transfer approach may take 
place as follows. The original color correction information generated by color 
profile server 18 can be stamped with a unique ID. The unique ID can be 
maintained in copies of the color correction information forwarded to subscribers 

10 22a-22n. This ID changes if the client 14a-14n repeats the color profiling 

process, and can be referred to as the profiler ID. The profiler ID will remain 
unchanged until the next pass through the color profiling process, which may 
occur months later. In effect, the profiler ID corresponds to a particular color 
profiling sequence. The profiler ID is supplemented by the client ID and the 

1 5 subscriber ID. The client ID identifies a client for whom a subscriber 22a-22n is 

requesting color information, and the subscriber ID identifies the particular 
subscriber. 

The client and subscriber IDs are passed via URL parameters to color 
profile server 18 whenever a color image server 16a-16n has no color correction 

20 information for a particular client 14a-14n. The subscriber ID is passed back with 

the color correction information fi-om color profile servef 18 to the color image 
server 16a-16n when the color profile server determines the appropriate 
information for the client, based on the contents of a profiler cookie or the results 
of running the color profiling process. Once color image server 16a-16n receives 

25 this information and writes it as a subscriber cookie to the client's browser, the 

subscriber ID is no longer needed. 

FIG. 4 is a flow diagram illustrating a color profiling process for a display 
device. A process as shown in FIG. 4 can be used to generate the contents of a 
profiler cookie as discussed above with reference to FIG. 3. Notably, the entire 

30 color profiling process can be completed by the user with as few as three "clicks" 
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of a pointing device. If the user is required to click a continue button to proceed 
after selecting a patch, the process may take additional clicks. If the user is 
permitted to proceed automatically following selection of a patch, however, the 
entire process can be completed in three clicks. With optional analog adjustment, 
5 separate R,G, and B blackpoints, and fine gamma steps, to be described, the 

process may require up to six or seven clicks. Also, in many embodiments, the 
color profiling process requires no plug-ins or client side scripting wHen utilizing 
the method of selecting discrete elements, although such mechanisms can be 
provided in some embodiments such as in the use of slider adjustments, 

10 The color profiling process enables visual profiling of a display device by 

determining accurate values of blackpoint and gamma for the R,G, and B 
phosphors or photodiode elements. Gamma refers to a parameter y that indicates 
the rate of change in light intensity with change in digital device value. The term 
"blackpoint" refers to the lowest RGB values capable of representation on the 

1 5 display device. For color values below the blackpoint, there is no further decrease 

in light emitted by the display device. Blackpoint is sometimes alternatively 
referred to as black onset. In accordance with the invention, three separate 
blackpoints are optionally determined, one for each of the R, G, and B color 
channels of the monitor. For use with more accurate monitors, a single dark gray 

20 RGB selection can be used to estimate a single average blackpoint value for R, G, 

and B. 

In some display devices, such as older CRT monitors, different color 
channels can produce very different blackpoints. Accordingly, reliance on a 
single RGB blackpoint measurement in generating a color profile can introduce 

25 inaccuracies. Determination of channel-specific blackpoints, however, can reduce 

the degree of inaccuracy. In other words, by estimating the blackpoint for each 
color channel individually, a more accurate characterization of the colorimetric 
response of the display device can be obtained. A more accurate colorimetric 
characterization enables greater accuracy in conversion of color images for 

30 delivery and display on the particular monitor. 
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Color profile server 18 may administer a color profiling process as shown 
in FIG. 4 by serving a series of instructional web pages to client 14a-14n. In 
general, the color profiling process may involve determination of (1) blackpoint 
for each of the red, green, and blue (R, G, and B) color channels of the display 

5 device, (2) average gamma for R, G, and B, and (3) differences in gamma for R, 

G, and B. Due to the wide range of differences in display device properties, 
determination (2) above can be subdivided into determination of (2a) a coarse 
gamma estimate, and (2b) a fine gamma estimate. This process is described in 
greater detail below with reference to FIGS. 4-11. 

1 0 As indicated by reference numeral 64 in FIG. 4, the color profiling process 

first involves determination of an estimated blackpoint for each of the color 
channels of the color display device, e.g., R, G, B. After determining the 
blackpoints, which may be merely an estimate, the color profiling process 
involves deteraiination of the gamma exhibited by the display device. In 

1 5 particular, the process may involve determination of a coarse ganrnia, as indicated 

by reference numeral 66, followed by determination of a fine gamma, as indicated 
by reference numeral 68. Determination of the fine gamma may rely in part on 
the coarse gamma. In other words, the coarse gamma can be used as an initial 
estimate and starting point for convergence toward a more finely tuned ganuna. 

20 After determining the fine gamma, the process may involve determination 

of the gray balance exhibited by the display device, as indicated by reference 
numeral 70 of FIG. 4. Gray balance provides an indication of the amount of color 
shift of a neutral gray toward one or more of the color channels used by the 
display device, e.g., red, green, and blue. The gray balance determination may 

25 rely in part on the gamma determined previously in the color profiling process 

and, in a particular embodiment, the fine gamma. Next, the color profiling 
process involves generation of a color profile, as indicated by reference numeral 
72. The color profile contains information that characterizes the color response of 
the display device based on the determinations indicated by reference numerals 

30 64, 66, 68, 70, i.e., blackpoints, gamma, and gray balance. The color profile then 
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can be loaded into a cookie, or other content container, and stored locally with 
client 14 for uploading to any of color image servers 16a-16n when needed, as 
indicated by reference numeral 74. 

The estimated blackpoint parameters define the dynamic range of the 
5 display device. Because the maximum RGB value always defines white, the 

blackpoint defines the black end point, and therefore defines the domain of values 
for each of the R, G, and B color channels that results in a continuous change 
fi-om black to white. Again, blackpoint refers to the R, G, or B value below which 
there is no fiirther decrease in light emitted by the display device. For an 

1 0 individual color channel, such as R, the blackpoint is the point at which fiirther 

decreases in the R value produce no fiirther decreases in R channel light emitted 
by the display device. If the blackpoint for a given color channel of a display 
device is high, values for that channel in darker regions will be mapped to the 
darkest shade and shadow detail will be lost if no image correction is performed. 

1 5 Accordingly, obtaining an accurate blackpoint estimate is important for the 

accuracy of images represented by the display device. 

In addition to a multi-channel blackpoint estimate, the color profile may 
include a gamma parameter and a gray balance parameter. The parameters 
together define the colorimetric response of an individual display device to enable 

20 modification of color imagery for more accurate representation on the device. 

The gamma parameter most affects the overall appearance of the image. Gamma 
determines whether an image appears overall too light or dark, or with too much 
contrast or too little. The third parameter, R, G, B gamma diffetrence or "gray 
balance," is important because the human eye is very sensitive to gray balance. 

25 The gray balance parameter indicates the relative balance, or imbalance, between 

the different color channels of a display device when producing RGB color 
combinations. 

FIG. 5 is a flow diagram illustrating a color profiling process as shown in 
FIG- 4 in greater detail. As shown in FIG. 5, for blackpoint determination, color 
30 profile server 18 first may serve a web page for display device adjustment. The 
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web page instructs the user to adjust the brightness and contrast of the display 
device. This step of display device adjustment is optional, but generally desirable 
in preparing the display device for blackpoint determination. As indicated by 
reference numeral 76, color profile server 1 8 may serve a web page containing 
5 several rows of dark elements such as bars, patches, characters, letters, numerals, 

and the like. 

Instead of patches or bars, it may be desirable to display elements with 
alternative shapes such as numerals. Whereas the patches or bars may be 
generally rectangular, more complex shapes can be used to aid the human eye in 

10 resolving differences. Thus, numerals, letters, and other complex shapes, for 

example, engage the pattern recognition capabilities of the human eye and can 
result in heightened sensitivity to gray scale differences. When the human eye is 
called upon to perform pattern recognition, its sensitivity to color gradations 
between a given pattern and a surrounding area increase. The complex shape 

1 5 presents a longer boundary relative to simple shapes, and promotes an increased 

perimeter for contrast. Elements with complex shapes may be used in the 
blackpoint, coarse gamma, and fine gamma determinations to characterize the 
monitor. 

As an alternative to rows, the elements can be arranged in columns 
20 placed side-by-side across the web page. As a further alternative, each row or 

column may contain, instead of several elements, only one or a small number of 
elements. A larger number of elements in each given row may aid the user in 
resolving differences between elements in adjacent rows. 

The web page may instruct the user to set the brightness and contrast of 
25 the display device to maximum, as indicated by reference nimieral 78. The rows 

(or columns) of elements may be arranged in a series. The elements in each row 
preferably exhibit the same darkness or lightness. However, the elements in each 
row in the series differ in relative darkness or lightness relative to the elements in 
other adjacent rows. For example, the darkest row of elements could be situated 
30 at the bottom, with rows containing elements with progressively lighter shades 
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being situated above in ascending order. As indicated by reference numeral 80, 
the web page instructs the user to reduce the brightness until the darkest row of 
elements is barely visible. At this point, the user may select "next" or some 
similar hypertext icon and proceed to the next step in the color profiling process, 
5 e.g., blackpoint determination for each of the red, blue, and green channels on an 

individual basis. 

FIG. 6 illustrates a web page 122 for use in display device adjustment in a 
color profiling process as shown in FIG. 5. Rows 124 of dark elements are 
displayed, with the elements each row having the same gray level value, but 

1 0 different gray level values fi'om elements in adjacent rows. As an example, rows 

124 of dark elements (shown as numerals in the example of FIG. 7) may be 
presented to the user with the following gray level values: 8, 16, 24, and 32. In 
other words, the rows of "zeros," "ones," "twos," and "threes" may have gray 
levels of 8, 16, 24, and 32, respectively. As the rows of dark gray elements are 

1 5 displayed, the user is instructed to set brightness and contrast of the display device 

to maximum, using the analog or digital controls provided with the display 
device. The user is then further instructed to reduce the brightness of the display 
device until the row with the darkest (lowest gray level value) elements is barely 
visible, and then click "next" upon completion. This optional step of display 

20 device adjustment serves to prepare the monitor for the blackpoint determination 

carried out with respect to each color channel, as described below. 

To carry out the blackpoint determination process for each color channel, 
several rows (or colunms) of dark elements for each color channel may be 
displayed on successive web pages. Specifically, red channel, blue channel, and 

25 green channel web pages for channel-specific blackpoint determination can be 

served to the client in any order. In each case, the dark elements for a given color 
channel may be arranged in rows in ascending or descending order of relative 
lightness or darkness, as in web page 122 of FIG. 6, which is served for display 
device adjustment. The rows provide a sequence of gray level gradations. 
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The bottom row for the red channel blackpoint determination web page, 
for example, may be a row of "zeros" having elements bearing the darkest shade 
(lowest gray value) of red among the elements shown on the web page. As with 
web page 122, arrangement of the elements in rows or columns is for purposes of 
5 illustration. In some embodiments, display of a series of individual elements 

(rather than rows of elements) may suffice. 

The row of darkest elements that is barely visible to the user will depend 
on the blackpoint for the respective channel of the display device. The rows of 
elements are displayed against a black, i.e., RGB = 0, background. With some 

10 display devices, the user may be unable to see elements with intensity levels of 8, 

1 6, or higher. The user is instructed to select the row of elements that is barely 
visible on the display device. This step determines the blackpoint, i.e., the visible 
"cut-off* point at which further decreases at which further decreases in the color 
channel value produce no further decreases in light emitted by the display device 

1 5 for that color channel. As an alternative, the user could be prompted to make the 

least visible row of elements vanish for a given color channel and then click on 
the remaining barely visible bar. In either case, the blackpoint can be estimated. 

FIG. 7 illustrates a web page 128 for use in blackpoint determination in a 
color profiling process as shown in FIG. 5. Web page 128 may be substantially 

20 similar to web page 122 of FIG. 6. For example, web page 128 may include rows 

1 30 of shaded elements. Again, display of columns of elements or a series of 
elements may be sufficient for some applications. As shown in FIG. 7, web page 
128 instructs the user to select the row of elements that is barely visible on the 
display device. As in web page 122, the rows 130 in web page 128 may be 

25 arranged as rows of "zeros," "ones," "twos," and "threes" having, for example, 

intensity levels of 8, 16, 24, and 32, respectively. Web page 128 in FIG. 7 
represents the web page for red channel blackpoint determination, and includes 
rows of red elements set against a black background. 

Upon selection of the row that is barely visible for the red channel, e.g., 

30 upon clicking on any element in the row, the user is automatically served a 
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substantially identical web page containing rows of green elements set against a 
black background for purposes of determining the green channel blackpoint. In 
this manner, the user selects a visible row or element that most closely appears to 
match, or blend with, the black background. Following selection of a row of 
5 green elements that is barely visible, a substantially identical web page for blue 

channel blackpoint determination is served to the user and the user makes a 
similar selection. Thus, successive web pages governing blackpoint ' 
determination for each color channel can be served automatically following 
selection of a row for a preceding channel. Alternatively, the user may be 

1 0 prompted to click on a "next" icon or similar device. Serving successive web 

pages automatically following selection of an element may be desirable, of 
course, to reduce the overall number of clicks involved in the process. 

In the above manner, the user selects the row of elements that is barely 
visible for each color channel, and thereby provides an indication of the 

1 5 blackpoint for each color channel. FIG. 5 further illustrates the process. In 

particular, FIG. 5 shows the display of rows of dark red elements or characters 
(82), and selection of the row that is barely visible (84), and further illustrates the 
computation of the estimated blackpoint for the red channel based on the selected 
row (86), Similarly, for the green channel, a row of dark green characters is 

20 displayed (88), followed by selection of the row that is barely visible (90), and 

computation of an estimated blackpoint for the green channel based on the 
selected row (92), Finally, for the blue channel, a row of dark blue characters is 
displayed (94), followed by selection of the row that is barely visible (96), and 
computation of an estimated blackpoint for the blue channel based on the selected 

25 row (98). 

Following selection of the barely visible row of elements displayed on 
each successive web page, client device 14a-l4n transmits the result to color 
profile server 1 8. Alternatively, the results for all color channels can be 
transmitted at the same time following completion of the blackpoint determination 

30 for the last color channel. Color profile server 1 8 then may compute the 
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estimated blackpoint for each channel, as indicated by reference numerals 86, 92, 
98, or simply store the parameters for later computation, e.g., by color imager 
server 16. 

The complete description of the display device behavior can be 
5 represented by the following equation which relates RGB to XYZ: 



11-1=1 n. 



r,max 
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where 



lo '[(<-U/0.o-*,.,)]<oJ 
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15 



B = 



'[(t/,-U/(1.0-*„,)]<0^ 



The variables dr, dg, and db are the digital input values normalized to 1 .0. The 
parameters koj, ko.g, and ko,b, are the blackpoints and the parameters Yr, Yg, and Yb 
are the gammas for the red, green, blue channels. 
20 The values of parameters ko,r, ko.g, and ko,b, are determined as follows: 

Assume that (regardless of the properties of a particular monitor) for the red 
channel there exists a minimal visible set of values for XYZ that can be detected 
by the human eye, designated as the vector (Xt,r,Yi.r,24,r). This vector will have a 
unique corresponding value for R in the expression above, designated as Rt. For a 
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particular monitor with specific values of and ko^ there will be a unique device 
value associated with Ri which is designated by di,,: 

_|[w,-*„)/(i.o-t„)r K-t.,)'(io-t,.,)>oi 

lo '[K.-*o.r)/(i.o-0]<oj 

5 

This device value dt,r is determined by the user during the color profiling 
procedure as described, i.e., by selecting the darkest barely visible row of 
elements in the blackpoint determination web page for red. The value of Rt is 
empirically determined. For example, for a calibrated display system in a dark 

1 0 room with ko.r = 0.0 and Yr = 2.2, a red patch may be visible for dt,r = 8/255 gray 

levels which implies Rt = (8/255)^ ^, 

The exact value of ko,r can be calculated by solving two simultaneous 
equations, namely the equation above for Rt and the equation for Rj3 which will 
be described below. Alternatively, a reasonable estimate can be made for ko,r by 

1 5 assuming a ganmia of 2.2. If this assumption is made, the value of koj can be 

estimated as: 

^255.0>' 

20 In a similar fashion, the values for ko^ and ko,b, can be determined. 

FIG. 8 is a flow diagram illustrating gamma and gray balance 
determination in a color profiling process as shown in FIG. 5. For determination 
of coarse gamma, one of the web pages served by color profile server 18 displays 
a range of green elements, e.g., patches, against a dithered green background, as 
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indicated by reference numeral 100. The coarse gamma determination web page 
can be served immediately and automatically following selection of a row of 
elements in the last blackpoint determination web page, or in response to selection 
of a "next" icon or similar device. 

5 In one embodiment, the coarse gamma determination is limited to only the 

green color channel. Specifically, the coarse gamma determination is made using 
a series of green elements against a green dithered background. Green is the most 
dominant and intense phosphor among red, green, and blue, and is highest in 
contrast. Green also has the highest L*. Note also that green most closely 

1 0 matches the photopic V(X) response of the eye. This approach to coarse gamma 

determination considers only the green color channel, and essentially ignores red 
and blue. In this manner, the coarse ganuna measurement concentrates on the 
most dominant color channel and avoids errors that can arise to the red-blue 
imbalances that are highly prevalent in many display devices. Thus, the elements 

1 5 displayed for the coarse gamma determination may be green patches with 

different darkness or lightness values. Alternatively, a combined coarse gamma 
for all of the color channels may be determined. 

Upon display of the green patches, the user is instructed to select a patch 
that appears to most closely blend with the dithered background, as indicated by 

20 reference numeral 102 in FIG. 8. The green patch "blends" with the dithered 

background in the sense that it appears to closely match the level of the 
background. An example of a range of green patches displayed against a green 
dithered background is shown in FIG. 9 and indicated by reference numeral 1 32. 
This range of green patches and the green dithered background can be displayed 

25 in a web page served by color profile server 1 8. Based on the selected green 

patch, which again may be selected by clicking on it with a pointing device, color 
profile server 18 computes a coarse gamma, as indicated by reference numeral 
104 in FIG. 8. The coarse gamma determined in this step can be used as an 
estimate for the average gamma of R, G, and B via selection of a green patch from 

30 the set of green patches against the dithered green background. The dithered 
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green background may be set at approximately 25% to 50%. Dithered 
backgrounds approaching approximately 33% may more closely match the actual 
midpoint of black to green transition for the display device, and may be preferred 
for typical display devices. 
5 By alternating black and green at an appropriate frequency, a 25%, 33%, 

or 50% green background can be produced. For a CRT, turning on or off all of 
the pixels in a given horizontal line should produce more predictable output from 
display device to display device than modulating individual pixels to form vertical 
lines, due to the video bandwidth of the device. For flat panel devices, this is less 
10 of an issue. To accommodate clients using both CRT's and flat panel devices, 

however, generation of the dithered background by use of alternating horizontal 
lines is preferred. 

The center patch in the range 1 32 of patches can be based on an average 
ganuna of 2.0, since most monitors range from 1 .6 to 2.5. The other green patches 
1 5 that surround the center patch may proceed in a sequence with relatively large 

steps, e.g., 8 gray levels apart from one another. Coarse gamma can be estimated 
using the equation: 

G33 = .333 =[(d[33^-^,.,)/a.0-^,,)J' 

20 

where d jj^g is the gray level value (normalized to 1 .0) of the selected patch that 
appears to most closely blend in with the background, ko.g is the previously 
determined blackpoint, G.33 is the relative intensity of the green chaimel (equal to 
1/3) , and yg is the green gamma. As an altemative to actually computing the 
25 coarse ganuna, the green level value of the selected patch simply is carried 

forward for use in the flne gamma process. In this case, the value can eventually 
be discarded. 

After the coarse gamma estimate is obtained, fme gamma is estimated. 
Fine gamma is a refmed or "fine-tuned" estimate for the average gamma of R, G, 
30 and B. Fine ganuna can be determined by selection of another green patch from a 
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set of green patches presented against a dithered green background. In this case, 
the center patch may be identical to the green patch selected by the user for 
determination of coarse gamma. Thus, the coarse gamma step "informs" the fine 
gamma step. In effect, the selected coarse gamma patch may serve as a starting 

5 point for the fine gamma determination. Specifically, the green patch selected in 

the coarse gamma determination can be used as the central patch for the fine 
gamma determination. 

A range of patches for determining fine gamma is illustrated in FIG. 10 
and designated by reference numeral 134. The patches in this range are in a 

10 sequence with smaller steps centered about the center green patch selected in the 

coarse ganmia process. For example, the patches may be set at 4 green levels 
apart, in contrast to the 8 green levels used as the difference for the coarse gamma 
determination. In this manner, a narrower range is used tio "fine-tune" the coarse 
gamma estimate, with the center of the range having been "learned" from the 

15 coarse gamma estimate. 

As indicated by reference numeral 1 06, a web page served by color profile 
server 1 8 displays the selected green patch from the coarse gamma estimate 
among a narrower range of green patches. The user then is instructed to select the 
green patch that most closely blends with the same dithered green background as 

20 used for coarse gamma, as indicated by reference numeral 108. Based on the 

selected patch, color profile server 1 8 computes a single fine RGB gamma, as 
indicated by reference numeral 1 10. Thus, the fine gamma is the overall gamma 
estimated for the RGB channels. Alternatively, as mentioned above, the RGB 
value of the selected patch can simply be stored for use by color image server 

25 1 6a- 16b in computing fine gamma and rendering color corrections. In any event, 

a refined estimate for gamma can be computed according to the equation: 



G,3 = .333 = [(^3,^-^,p/(1.0-A:„pf 
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where d.33,g is the green level value (normalized to 1.0) of the selected patch that 
blends in with the background, ko.g is the previously determined blackpoint, G.33 
is the relative intensity of the green channel (equal to 1/3) , and yg is the green 
gamma. 

5 To determine gray balance, color profile server 1 8 serves a web page that 

displays a plurality of RGB patches. The RGB patches can be generated with the 
same value of green selected in the previous fine gamma step in conjunction with 
values of red and blue that are substantially equal to or systematically shifted 
from the previously selected value of green. The RGB patches can be displayed 

1 0 against a gray background which is dithered in the same manner as the green 

dithered background of the previous step (fine gamma), as indicated by reference 
numeral 1 12. Again, this step "learns" fi-om the previous one, and forms part of a 
cascading series of color profiling steps (coarse gamma, fine gamma, and gray 
balance) that help narrow the search for the correct gamma. As indicated by 

1 5 reference numeral 1 14, the user is then instructed to select the gray patch that 

appears to most closely blend with the dithered background. Based on the 
selected gray patch, individual RGB gammas are computed, as indicated by 
reference numeral 1 16. Notably, the overall gray balance determination can be 
made with a single click of the user's pointing device. 

20 Thus, in this gray balance process, the green intensity value selected in the 

fine ganrnia process is used to generate the gray patches that exhibit +A 
(plus/minus) differences or "shifts" in red and blue about the value of the central 
gray patch derived from the gamma estimate. For example, the value of green 
selected in the fine gamma process can be displayed in the center of the range in 

25 conjunction with substantially identical values of red and blue. The gammas for 

red and blue are then fine tuned by the gray balance determination, which helps 
identify red-blue imbalance in the display device. Thus, the green gamma is 
"locked in" in the gray balance step, while the red and blue imbalance is 
determined. In other words, every patch in the gray balance array carries the 

30 same green value, but is modulated by different gradations of red and blue. This 
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Step eliminates one axis of variation, green, but permits identification of any 
imbalance between red and green or blue and green. This limits the range of 
choices to a more finely-tuned area, and aids the user in making a more accurate 
selection. 

5 The range of patches for the gray balance determination may be a two- 

dimensional array of patches with red-blue-shifted patches arranged around a 
central gray patch formed according to the gamma estimate from the fine gamma 
process. In other embodiments, the red chaimel could be used to determine the 
initial RGB gamma estimate, followed by a gray balance determination that 

1 0 resolves imbalance between green and red or blue and red. 

FIG. 1 1 illustrates an example of a two-dimensional range 1 36 of gray 
patches arranged in a five-by-five matrix for use in the gray balance 
determination. Each patch represents a shift away from the central gray patch 
along either the blue axis, the red axis, or a combination of both, but preferably 

1 5 does not represent any further green shift. The user selects the patch that appears 

to most closely blend with the dithered gray background, which may be a 33% 
dithered background. The central patch can optionally be highlighted to indicate 
it is the preferred default choice. 

The number of patches and the exact values of RGB for each patch can be 

20 quite flexible. For example, in the case of the image in FIG. 1 1 , all patches can 

be selected to have identical values of L* as indicated by the estimated profile for 
the display based on phosphors, average gamma, and blackpoint. Patches 
adjacent to the center may differ by all permutations of +/- 3 AE for a* and for b* 
as estimated firom a Matrix TRC (tone reproduction curve) profile constructed 

25 from the above parameters. 

Patches around the outer perimeter of the grid array may differ from the 
center by +/- 6 AE in R and B. Alternatively, for simplicity, one can elect to vary 
R and B only by +/- a fixed amount such as +/- 5 gray levels and +/- 1 0 gray 
levels. Preferably, all patches are relatively small deviations from the central 

30 patch in all directions of color space of approximately constant L*. This test will 
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help determine in a sensitive manner whether there exists a significant difference 
in the gammas of R, G, and B, and thereby expose significant gray imbalance 
between R and B. 

The two-dimensional format of the patches shown in FIG. 1 1 may aid the 
5 user's selection of the correct patch. The patch from the previous step in the color 

profiling process, i.e., fine gamma, is placed at the center in this embodiment. 
Adjacent patches differ in gray level as the array extends outward such that the 
outer periphery of the array contains patches that are two gradations removed 
from the central patch. The array produces a visual "funnel" effect that, from 
10 experience, tends to direct the user toward the central patch as the starting point 

for matching with the background. The differences between patches in the two- 
dimensional array are more clear and dramatic than in a <ine-dimensional strip of 
patches. As the array extends outward, the shift becomes greater. Thus, the 
gradations are well pronounced and aid the user in picking the appropriate patch 
1 5 which, in many cases, will be the central patch selected in the previous step of the 

color profiling process. 

If the user selects the central patch, a single gamma value is used for the 
R, G, and B channels. If one of the other patches are selected, three separate 
gammas are calculated based on the equations: 

20 

R,, =.333 =[(^33,, -*o..)/0 0-A„^,)p 
B33 = .333 =[(dr33,-*,,)/(l.0-^,,)f 

where the subscripts for y and d.33 indicate unique values for the R and B 
25 channels. The values for d.33 for each channel are given by the values of RGB of 

the particular patch selected in this gray balance step. These equations are 
combined with a set of phosphor values to generate accurate profiles for the 
client's display device, using equations well known in the art, and referred to as 
Matrix TRC formalism in the Intemational Color Consortium (ICC) specification. 
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Again, calculations can be performed by color profile server 1 8 or by a color 
correction module associated with color image servers 16a-16n. 

The process of selecting patches in the coarse gamma, fine gamma, and 
gray balance determination steps is advantageous because, in preferred 
5 embodiments, it requires no applications, applets, or other client-side scripts to be 

loaded at the client side. Rather, the user may simply select one of the patches 
displayed in a web page. In other embodiments, however, if applications, 
applets, or client-side scripts are used, it is conceivable that smooth slider bars, 
arrows, and the like could be used to adjust the color of a single patch in real-time 

1 0 for comparison to the dithered background. In this manner, the user has the 

ability to precisely match a single patch to the background, rather than select fi'om 
a finite set of patches the one that most closely matches. This technique of real- 
time adjustment also may be usefiil for non-networked approaches to color 
calibration and characterization. In this case, for blackpoints, gamma, and/or gray 

1 5 balance, the patch or element selected by the user may be a single adjustable 

patch in a condition in which the slider or other adjustment medium has adjusted 
its color to a level that is visually acceptable to the user, i.e., to a point at which 
the patch appears to match the dithered background. 

Based on the blackpoint, coarse gamma, fine gamma, and gray balance 

20 processes, a color profile for the display device is generated, as indicated by 

reference numeral 1 1 8. Upon generation of the color profile, a color profiler 
cookie is created, as indicated by reference numeral 120. Information 
representative of the color profile is added to the color profiler cookie for fiiture 
use. In particular, the information can be used to create a subscriber cookie for 

25 future interaction between the particular client 14a-14n and the particular 

subscriber 22a-22n and color image server 16a-16n. Although the color profile is 
especially useful for characterizing display devices in a network, it also may be 
usefiil in a non-networked application. In particular, the color profiling process 
described herein may find ready use in the calibration and characterization of an 
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individual display device for correction of content generated or obtained locally 
with the device, rather than across a network. 

Advantageously, there is no need for the client 14a-14n to provide 
information regarding the configuration of its display device. Very satisfactory 
S results can occur using an average set of phosphor values based on published 

standards such as sRGB, Apple Macintosh RGB, and the like. If desired, further 
steps can be added, particularly in order to address the issue of phosphor values 
and white point. The color profiling process simply results in generation of a 
cookie that serves as a container and vehicle for passing information 

1 0 characterizing the color response of the display device associated with client 14a- 

14n to color image server 16a-16n. Alternatively, the chromaticity information 
and white point can in some cases be obtained from the display utilizing 
commimication protocols such as VESA and/or firom the operating system of the 
computer. The usefulness of this invention will continue because, with current 

1 5 technology, the RGB blackpoints and gammas are diflficult to maintain perfectly 

at the hardware level even with expensive electronic circuitry. 

Ordinarily, all cookies visible to a particular domain are attached to each 
request from a browser application executed by a client 14a-14n. For this reason, 
a typical browser limits each domain to a maximum of twenty cookies. To avoid 

20 consuming the allotment of cookies for a particular subscriber 22a-22n, all of the 

color correction information for a particular client 14a-14n preferably is packed 
into a single profiler cookie and a single subscriber cookie. For example, a 
number of items can be packed into the value string of the subscriber cookie or 
the profiler cookie, as the case may be. In particular, each cookie should include 

25 the gamma values for R, G, and B. Each gamma value may be a value between 

1 .0 and about 3.0. In addition, the cookie may include the chromaticity values for 
black and white, e.g., expressed as a value between 0 and +1000.0. 

An exemplary cookie may have the following items packed into its value 
string, each demarcated by a separator: 
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(1 ) Cookie format version code - a numeric code, e.g., 1 to 3 bytes, 
plus separator. 

(2) Cookie installation date - the usual cookie-style timestamp 
(milliseconds after midnight of Jan, 1, 1970, GMT), e.g., 12 to 13 bytes, plus 

5 separator. 

(3) Unique profiler ID assigned to this color information when it is 
generated by the color correction sequence; a long integer, e.g., 4 bytes, plus 
separator (but possibly longer). 

(4) Ganuna and blackpoint values for R, G, B - each a text 

10 representation of a floating-point value between 1 .0 and gibout 3.0, retaining 4 

decimal digits. The decimal point could be implied. Thus, the gamma values 
may take up 5 or 6 bytes plus a separator each, or three times that overall. 
Alternatively, the selected tint values chosen for R, G, and B can be indicated, 
enabling the gamma and blackpoint values to be calculated at a later time by a 

1 5 server upon upload of the cookie. 

(5) Chromaticity for Black and White - each a text representation of a 
floating-point value between 0 and +1000.0, retaining 4 significant digits. Thus, 
this may take up 6 or 7 bytes plus a separator each, or two times that overall. 

(6) Number of bits per color - two decimal digits: two bytes plus 
20 separator 

(7) Display Device ID code - an alphanumeric code, which may be 
roughly 10 bytes plus separator. 

(8) Cookie Data Checksum - a long integer: 4 bytes. 

The example cookie described above has about 68 bytes plus 10 separators. The 
25 separator character should be chosen so that the string does not have to be 

"escaped"; the caret (^) is frequently used this way. Thus, the typical size for the 

value string may be about 80 bytes. 

FIG. 12 is an example of a color image 184 transmitted to a client 14a-14n 

in a system as shown in FIGS. 1 and 2. As shown in FIG. 12, the image 184 may 
30 be presented on a screen 1 82 on a display device associated with a client 14a-14n. 
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A color image server 16a-16n associated with a particular subscriber 22a-22b, 
such as "ABC Company," delivers image 184 to the client 14a- 14n upon request. 
For purposes of illustration, image 184 may be accompanied by a legend 186 that 
identifies the subscriber 22a-22n and a particular item being displayed. Also, an 
5 icon, button, or the like may accompany image 1 84 and indicate whether color 

correction has been applied by color image server 16a-16n, as indicated by 
reference numeral 188. In the example of FIG. 12, color correction has not been 
applied, e.g., because a subscriber cookie has not yet been generated for the 
particular subscriber 22a-22n, Another icon, button, or the like may be displayed 
1 0 to invite the user to profile its display device, as indicated by reference numeral 

190. 

Elements 188 and 190 could be integrated with one another, as discussed 
previously, and take on an appearance such as a particular color scheme that 
indicates whether color correction has been applied. In either case, element 190 

1 5 provides a hypertext link to the URL associated with color profile server 1 8. 

Thus, when the user clicks on element 190, pages are requested from color profile 
server 1 8 for initiation of the color profiling process. If a profiler cookie already 
exists, however, it is sent by client 14a-14n to color profile server 18. In that 
case, there is no need to repeat the color profiling process. Instead, color profile 

20 server 1 8 creates a subscriber cookie for the pertinent subscriber 22a-22n, and 

forwards it to the associated color image server 16a-16n, either directly without 
user intervention or indirectly with user approval as previously described. 

FIG. 13 is block diagram illustrating transmission of color correction 
information in a system as shown in FIGS. 1 and 2. In particular, FIG. 13 

25 illustrates a situation in which subscriber cookies have already been created for 

color image servers 194, 198 associated with particular subscribers 22a-22n 
accessed by an individual client 196. In this case, upon accessing a web page 
from a subscriber server 12a-12n, client 196 requests images from color image 
server 194. When requesting images from another subscriber 22a-22n, client 196 

30 requests images from color image server 198. Color image server 194 



44 



wo 02/063563 



PCTAJSOl/20613 



incorporates both a color correction module 200 and an archive 202 of color 
images. Similarly, color image server 198 includes a color correction module 204 
and an archive of color images 206. 

When client 196 sends an image request to color image server 194, it 

5 sends along a color profile cookie, i.e., a subscriber cookie, as indicated by line 

208. Likewise, as indicated by line 210, client 196 sends a subscriber cookie to 
color image server 198 when requesting an image. In each case, the Subscriber 
cookie contains a color profile that provides color correction information for use 
by the respective color correction module 200, 204 in modifying, i.e., color 

10 correcting, the color images served from image archives 202, 206, respectively. 

Thus, when a request is received, color images server 194 or 198 processes the 
accompanying subscriber cookie to extract the contents, and controls the color 
correction.module 200, 204 based on the extracted contents. In this manner, 
client 1 96 receives color corrected images, as indicated by reference numerals 2 1 2 

15 arid 214. 

The manner in which color correction modules make use of the color 
profiles contained in the subscriber cookies will now be described. The foregoing 
discussion associated with FIGS. 4-1 1 above has utilized.simplified one 
dimensional formulas to explain the relevance of blackpoint, average gamma, and 

20 adjusted gammas for RGB to account for gray balance. In the embodiment 

described with reference to FIGS. 4-11, blackpoints for each color channel are 
estimated based on red, green, and blue elements selected by a user associated 
with a respective client 14a-14n; Thus, the output of the color profiling process is 
a blackpoint RGB value and a gamma, or individual RGB gammas. Now we 

25 assume that these values have been determined in the manner described above. 

The complete description of the display device behavior can be given by the 
following equation which relates RGB -> XYZ: 
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The variables dr, dg, and db are the digital input values normalized to 1 .0. The 
parameters ko,r, ko.g, and ko^b^ arc the blackpoints for the red, green, and blue 
channels, and the parameters yr, yg, and yb are the gammas for the red, green, blue 
channels. Thus, the gamma and blackpoint information contained in the 

1 5 subscriber cookie for a respective display device can be used in the above 

equations to produce, in effect, a destination device profile. The destination 
device profile, with a source profile previously computed for the requested image, 
can be used to perfomi a transformation of the image data sufficient to produce 
calibrated output on the display device. 

20 The above approach is different than other attempts to characterize display 

devices such as equation 21 in Bems, "CRT Colorimetry. Part I: Theory and 
Practice." In most characterizations, the "k" parameters are used to describe 
black offset rather than blackpoint. Black offset refers to the non-zero intensity 
measured or perceived from a display for RGB=0. In our experience, the 
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contrast/brightness adjustment procedure used in a color profiling process in 
accordance with embodiments of this invention minimizes the effect of this 
phenomenon. However, non-zero blackpoints are very possible even after the 
contrastA)rightness adjustment, and therefore should be taken into account. 
5 This profile description can either be used in this format or converted to 

formats such as those specified by the ICC. This format is also known as the 
Matrix TRC format, and utilizes a generic lookup table for the expressions above 
for R, G, and B rather than an equation combined with a matrix similar to above. 
The above information, e.g., gammas, blackpoints, and the like, can be stored in a 

10 cookie on a computer associated with a client 14a-14n. Alternatively, the 

individual data which are the RGB values of the patches selected by the user can 
be stored in the cookie, which can permit improved profile technology to be 
employed at a later date utilizing the same input information. 

To implement a system as described herein with an existing archive of 

1 5 images and HTML codebase for a particular subscriber 22a-22b, the existing 

subscriber server 12a-12n is modified to replace existing image file references 
indicated in HTML pages with similar references to a pertinent color image server 
1 6a-l 6n equipped with a color correction module. For example, an existing 
subscriber image file reference called: 

20 http://SubscriberName.com/images/ImageName.jpg 
could be replaced with: 

http://coiTection.SubscriberName.com/images/ImageName.jpg. 
These modified references in the HTML page then issue a command to the color 
image server 16a-16n to serve the requested image. When the color image server 

25 1 6a- 1 6n receives the command, it also receives the subscriber cookie, if one 

exists, and applies the information contained in the cookie to perform color 
correction. The color image server 16a-16n then reads the pertinent image file, 
creates a unique display profile utilizing the display parameters stored in the 
subscriber cookie, and converts the image from source to destination before 

30 sending it to the client's browser. 
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Ail images Stored on the subscriber server 12a-12n may have a 
corresponding copy file of the same name residing on the subscriber color image 
server 16a-16n. The color image server 16a-16n may access this database of 
image files to read, convert, and send images referenced by the HTML page sent 
to the client 14a-14n. According to one embodiment, color image server 16a-l 6n 
may use a very simple and quick technique for color management. In particular, 
all images on the color image server 16a-16n preferably have a predetermined 
RGB color space. This typically means that original images are converted from 
the color space of corresponding source devices, e.g., such as scanners, digital 
cameras, and the like, to the standard color space determined by the subscriber 
22a-22n. Good examples of standard RGB color spaces are ColorMatch RGB, 
which has a colpr temperature for the "virtual display" of D50. Other color 
spaces such as Adobe RGB have an excellent gamut, but have a color temperature 
of D65. When an image on an HTML page sent to the client 14a-14n is 
referenced via the color image server 16a-16n associated with a subscriber server 
12a-12nsuchas: 

correction.SubscriberName.com/images/ImageName.jpg 

color image server 16a-16n accesses the corresponding image and converts the 
RGB data in real time before sending the image to the client destination. The 
conversion can be performed according to the following calculation: 



48 



wo 02/063563 



PCT/USOl/20613 



10 



5 jK-*'..»^>'(^-«-u)r 



G. 1=1 r y K I I r r 7. I 



X 


A.c.inax 


V\x 


X 


Y 




1 1 y 








J L ^r^jMX 





r,cmax 'j?,c,niax 'A,cmax » . '*M,max 'ir^.f.max *^,max j 



UJ Vi 



Note that the matrices above can be concatenated into a single matrix for 
increased processing speed. 

FIG. 14 is a block diagram illustrating an alternative architecture for a 
system 214 for improving color image display accuracy in a computer network. 

15 System 214 conforms substantially to the system shown in FIG. 2, except that all 

images for the subscribers are stored at a central color image server 16. Color 
profiling server 18 may reside or be integrated with color image server 16 in the 
embodiment of FIG. 14. In this case, color profiling server 18 provides web 
pages for guidance of a color profiling process as described herein. Color image 

20 server 16 or color profile server 1 8 may include a database server for storage of 

individual color profiles associated with clients 14a-14n. When a client 14a-14n 
requests an image tagged in the code sent by one of subscriber servers 12a-12n, it 
is directed to the central color image server 1 6. The color image server 1 6 may 
use a client ID sent from the client to retrieve the appropriate color profile and 

25 apply it to modify the requested color image using techniques as described herein 

for color correction. In this manner, color image server 16 provides color 
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corrected images without the need for transfer of cookies and the like between 
clients 14a-l4n and the color image server. 
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CLAIMS: 

1 . A method comprising: 

displaying a sequence of dark elements against a black background, 
wherein each of the dark elements has a different gray value and a non- 
rectangular shape; 

estimating a blackpoint for a display device based on one of the dark 
elements selected by the user that is visible and appears to most closely match the 
background. 



2. The method of claim 1 , further comprising: 

modifying a color image for the display device based on the estimated 
blackpoint; and 

delivering the modified color image via a computer network for display on 
1 5 the display device. 

3. The method of claim 1 , wherein the display device is associated 
with a client on the computer network, the method further comprising: 

transmitting information representative of the estimated blackpoint from 
20 the client to a server on the computer network; 

modifying the color image via the server based on the information; and 
delivering the modified color image from the server to the client for 
display on the display device. 



25 4. The method of claim 3, further comprising: 

storing the information in a web cookie; 
transmitting the web cookie from the client to the server; and 
modifying the color image via the server based on the contents of the web 

cookie. 

30 
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5. The method of claim 1 , wherein the display device is associated 
with a client on the computer network, the method further comprising: 
generating a color profile based on the estimated blackpoint; 
transmitting the color profile from the client to a server on the computer 

5 network; 

modifying the color image via the server based on the color profile; and 
delivering the modified color image from the server to the client for 
display on the display device. 

10 6. The method of claim 1, further comprising: 

displaying dark elements against the black background for each of the 
color channels of the display device; 

selecting one of the dark elements for each of the color channels that is 
visible and appears to most closely match the black background; and 
1 5 estimating channel-specific blackpoints for the color channels of the 

display device based on the selected dark elements. 

7. The method of claim 6, wherein the color channels are red, green, 
and blue color channels. 

20 

8. Themethodofclaim?, wherein the display device is a cathode ray 
tube monitor or a flat panel display. 

9. The method of claim 1 , wherein the non-rectangular shapes include 
25 a numeral or a letter. 

1 0. The method of claim 1 , further comprising: 
estimating a gamma and gray balance for the display device; 
generating a color profile for the display device based on the estimated 

30 blackpoints, the gamma, and the gray balance; and 



52 



wo 02/063563 



PCT/USOl/20613 



10 



modifying the color image for the display device using the color profile. 

11. A computer readable medium containing program code that causes 
a processor to: 

displays dark elements against a background, wherein each of the dark 
elements has a different gray value and a non-rectangular shape; 

estimates a blackpoint for a display device based on one of the dark 
elements selected by the user that is visible and appears to most closely match the 
background. 



12. The computer readable medium of claim 1 1, wherein the code 
causes the processor to: 

modify a color image for the display device based on the estimated 
blackpoint; and 

1 5 deliver the modified color image via a computer network for display on 

the display device, and 

13. The computer readable medium of claim 1 1 , wherein the display 
device is associated with a client on the computer network, and the code causes 

20 the processor to: 

transmit information representative of the estimated blackpoint from the 
client to a server on the computer network; 

modify the color image via the server based on the information; and 
deliver the modified color image from the server to the client for display 

25 on the display device. 

1 4. The computer readable medium of claim 1 3, wherein the code 
causes the processor to: 

store the information in a web cookie; 
30 transmit the web cookie from the client to the server; and 
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modify the color image via the server based on the contents of the web 

cookie. 

15. The computer readable medium of claim 1 1 , wherein the display 
5 device is associated with a client on the computer network, and the code causes 

the processor to: 

generate a color profile based on the estimated blackpoint; 

modify the color image based on the color profile. 

transmit the color profile from the client to a server on the computer 
10 network; 

modify the color image via the server based on the color profile; and 

deliver the modified color image from the server to the client for display 
on the display device. 

15 16. The computer readable medium of claim 1 1 , wherein the code 

causes the processor to: 

display dark elements against the black background for each of the color 
channels of the display device; 

select one of the dark elements for each of the color channels that is 
20 visible and appears to most closely match the black background; and 

estimate channel-specific blackpoints for the color channels of the display 
device based on the selected dark elements. 

1 7. The computer readable medium of claim 1 6, wherein the color 
25 channels are red, green, and blue color channels. 

1 8. The computer readable medium of claim 17, wherein the display 
device is a cathode ray tube monitor or a flat panel display. 
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1 9. The computer readable medium of claim 1 1 , wherein the non- 
rectangular shapes include a numeral or a letter. 

20. The computer readable medium of claim 1 1 , wherein the code 
causes the processor to: 

estimate a gamma and gray balance for the display device; 
generate a color profile for the display device based on the estimated 
blackpoints, the gamma, and the gray balance; and 

modify the color image for the display device using the color profile. 



21. A system comprising: 

a web server residing on a computer network, the web server transmitting 
web pages to remote clients residing on the computer network; 

a color image server residing on the computer network, the color image 
1 5 server transmitting color images referenced by the web pages to the clients for 

display on display devices associated with the clients; 

a color profile server residing on the computer network, the color profile 
server guiding the clients through a color profiling process to obtain information 
characterizing the color responses of the display devices associated with the 
20 clients, wherein the information includes a blackpoint estimate for the color 

channels of the display devices, and the color profiling process includes: 

displaying dark elements against a black background, wherein each 
of the dark elements has a different gray value and a non-rectangular 
shape, 

25 selecting one of the dark elements that is visible and appears to 

most closely match the black background, and 

estimating the blackpoint for a display device based on the selected 
dark element; and 
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one or more color correction modules that modify the color images 
transmitted by the color image server based on the information to improve the 
accuracy of the color images when displayed on the respective display device. 
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